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Final  Technical  Report  -  year  3  (final  year)  of  the  project  (AFOSR  F49620-93-1-0260  (previouslv:-9I-022^ 


The  overall  goal  of  our  work  is  to  detail  the  temporal  course  of  information  integration  as  it  takes  place 
during  plausible  reasoning,  with  a  focus  on  determining:  1)  the  component  processes  in  terms  of  their  time- 
courses  and  information  content;  2)  the  degree  to  which  stages  of  reasoning  represent  "modular" 
(autonomous,  independent,  informationally  encapsulated)  stages  of  processing  (as  compared  to  a  totally 
"interactive"  system);  and  3)  how  various  putative  components  of  reasoning  are  drawn  together  to  eventuate 
in  a  single  answer  to  a  reasoning  problem  .  The  woric  in  this  3-year  grant  period  has  involved  the  pursuit  of 
three  particular  lines  of  inquiry,  in  consonance  with  these  goals.  Note  that  while  there  was  only  one  year  of 
support  at  the  University  of  California,  San  Diego,  this  was  actually  the  third  year  of  support  on  the  project 
(CUNY  and  UCSD),  hence  ^  work  is  summarized  here. 


1.  Conceptual  Combination 

The  first  of  these  focused  on  the  examination  of  the  temporal  course  of  processing  during  conceptual 
combination.  Our  first  set  of  studies  were  based  on  examination  of  recent  claims  by  Springer  and  Murphy 
(1992)  that  conceptual  combination  takes  place  in  a  totally  interactive  fashion.  The  reason  for  starting  with 
their  work  is  that  their  argument  that  there  are  no  (initial)  "independent"  stages  of  literal  processing  that 
precede  the  conceptual  combination  of  information,  invalidates  the  basic  premise  of  much  of  our  proposed 
work  in  this  area  (namely,  that  there  are  independent  components  in  conceptual  combination  at  some  (early) 
point  in  processing  that  each  contribute  individually  in  conceptual  combination.) 

In  Springer  and  Murphy's  experiments,  subjects  were  required  to  make  true/false  decisions  to  phrases  such 
as:  "Peeled  Apples  are  'X'  ",  (where  'X'  was  either  a  common  'literal'  property  of  the  noun  (Apple)  such  as 
'RED'  or  a  so  called  'emergent'  property  of  the  adjective-noun  combination  (Peeled  Apple)  such  as  'WHITE'. 
This  emergent  property  was  intended  to  be  one  that  was  not  a  part  of  the  normal  property  list  for  either  the 
adjective  or  noun  by  itself,  but  only  one  which  "emerged"  fi'om  the  combination  of  these  items.  (There  were  2 
other  conditions  in  their  experiment,  but  they  are  not  relevant  to  the  focus  of  our  work  and  this  discussion). 
They  reported  finding  that  verification  of  such  "emergent"  properties  was  as  rapid  as  that  for  'literal' 
properties,  and  concluded  that  these  emergent  properties  were  made  available  immediately  (interactively)  and 
that  there  was  no  stage  in  which  the  'literal'  properties  of  the  noun  (or  adjective)  alone  were  first  made 
available,  prior  to  the  activation  of 'emergent'  properties.  This  conclusion  is  quite  contrary  to  our  basic 
research  hypothesis,  and  it  seemed  a  critical  place  to  begin  our  research.  A  fundamental  reason  to  doubt  the 
conclusions  of  Springer  and  Murphy  resides,  in  the  first  instance,  in  the  observation  that  the  dependent 
measure  they  used  (an  end-of-sentence  verification  task)  is  'off-line",  in  that  it  examines  the  categorical- 
combination  process  only  well  after  it  has  been  completed.  Thus,  it  seemed  likely  to  us  that  an  'on-line'  test  of 
categorical  combination  —  one  that  examined  activation  of  meaning  while  the  words  were  being  processed  - 
might  reveal  that  adjectives  and  nouns  combine  in  a  maiuier  that  is  far  more  intricate  than  revealed  by 
Springer  and  Murphy's  "off-line"  examinations. 

Our  initial  experiment  used  the  20  Springer  and  Murphy  experimental  items  (which  they  kindly  provided  to 
us) ,  along  with  40  additional  items  that  we  constructed  along  similar  lines  as  their  items,  in  a  speeded 
reaction  time  procedure.  In  this  procedure,  subjects  were  presented  visually  with  ,  first,  an  '*'  (to  get  the 
subject's  attention),  followed  by  a  presentation  for  1000  msecs  of  the  adjective-noun  pair  ('PEELED 
APPLE')  followed  100  milliseconds  later  with  a  single  word  which  the  subjects  had  to  'name  aloud'.  This 
word  was  either  a  property  of  the  noun  alone  ('RED')  or  an  "emergent"  property  of  the  adjective-noun  pairing 
CWHITE'),  or  a  control  word  for  each  of  these  probes  (control  words  were  matched  for  frequency,  length. 
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and  naming  time  with  the  property-probe  words,  but  were  unrelated  to  either  the  noiui  or  the  adj.-noun 
combination).  Subjects  were  required  to  "name"  these  word  aloud  as  rapidly  as  possible.  The  principle 
behind  use  of  this  task  rests  on  the  semantic-priming  effect;  if  a  property  of  either  APPLE  or  PEELED 
APPLE  has  been  activated  by  the  time  the  property  word  (RED  or  WHITE)  is  displayed  for  naming,  it  will 
'prime'  or  facilitate  such  naming,  as  compared  to  naming  of  the  mu'elated  control  word.  We  anticipated  that 
1000  msecs  of  processing  time  was  more  than  sufficient  for  the  'emergent'  property  to  be  activated  from  the 
adjective-noun  combination,  and  thus  we  predicted  that  results  from  this  initial  experiment  would ,  in  a  sense, 
replicate  the  results  of  Springer  and  Murphy  ~  that  is,  that  both  RED  and  WHITE  would  be  'primed'  if  the 
subjects  had  more-than-sufficient  time  (1000  msecs)  to  process  the  material  and  reflect  on  it. 

The  initial  results  were  in  accord  with  this  prediction.  Both  the  word  related  to  the  noun  alone  (e.g.,  RED) 
and  that  related  to  the  "emergent"  property  of  the  conceptual  combination  (e.g.,  WHITE)-  were  facilitated 
relative  to  their  controls  in  this  experiment.  This,  then,  roughly  replicated  the  Springer  and  Murphy  findings, 
but  with  a  slightly  different  test  format.  Thus,  given  enough  time,  it  appears  that  both  the  noun  and  the 
"emergent"  properties  are  both  available(activated).  The  critical  question  concerned  whether  there  are 
different  time-courses  of  availability  for  these  two  "meanings",  and  whether,  if  one  tests  closer  to  the  point  at 
which  these  words  are  just  initially  being  processed,  it  might  be  discovered  that  the  noun  meaning  alone  is 
activated  (accessed)  before  that  for  the  conjoint  meaning  for  the  adjective  -noun  combination. 

Thus,  in  the  second  experiment  of  this  set,  we  presented  the  combined  adjective-noim  pair(e.g.,  PEELED 
APPLE)  for  a  shorter  display  time  (400  msecs)  before  presentation  of  the  property-probe  (or  control)  word. 
Pilot  work  indicated  to  us  that  400  msec  was  sufficient  time  to  just  barely  be  able  to  read  both  words,  on 
average.  Thus,  we  reasoned  that  not  much  more  than  initial  processing  of  these  items  would  have  taken  place 
in  the  allotted  time,  before  the  probe  word  was  displayed.  The  results  from  this  test  were  some  what 
surprising;  again,  both  the  noun  and  the  emergent  property  probes  were  facilitated  relative  to  the  control 
words.  Upon  initial  consideration,  it  appeared  that  Springer  and  Murphy  might  have  been  correct  “  that  the 
emergent  property  was  available  as  rapidly  as  the  noun  property,  suggesting  that  there  was  no  initial  stage  in 
which  the  noun  and  adjective  properties  were  considered  independently. 

However,  at  this  point,  it  was  discovered  that  there  was  a  serious  difficulty  with  the  "emergent"  property 
probes  used  by  Springer  and  Murphy  (as  well  as  those  additional  items  we  had  created,  following  Springer 
and  Murphy).  It  turned  out  that  these  so-called  "emergent"  properties  were  all  highly  related  to  the 
ADJECTIVE  in  the  adjective-noun  pair.  Thus,  whatever  activation  was  being  obtained  for  the  so-called 
"emergent"  property  was  potentially  just  activation  caused  by  the  adjective  alone.  In  short,  neither  Springer 
and  Murphy's  materials,  nor  our  extra  materials  provided  a  test  of  the  hypothesis  at  all.  To  further 
substantiate  this  hypothesis,  we  ran  a  ratings  test  in  which  we  asked  subjects  to  rate  how  related  each  word 
(the  Adjective  alone  and  the  Noun  alone)  of  the  combination,  and  the  combination  itself,  was  to  the 
"emergent"  property  probe.  14  of  the  20  items  used  by  Springer  and  Murphy  were  judged  to  have  a  strong  - 
to-  very  strong  relationship  to  the  "emergent"  probes  (on  a  7-point  scale  ranging  from  no-relationship  to  very- 
strong  relationship).  Interestingly,  only  18  of  20  of  the  adjective-noun  combinations  used  by  Springer  and 
Murphy  were  judged  to  have  an  equally  strong  relationship  to  the  "emergent"  probe.  Thus,  in  only  5  of  the 
original  Murphy  and  Springer  materials  were  there  any  true  "emergent"  properties  present  (Note  that  the 
examples  provided  in  the  published  Springer  and  Murphy  paper  ( "peeled-  apples  and  boiled  celery) 
constitute  2  of  these  5  items).  A  similar  ratio  existed  for  the  materials  we  created  to  extend  their  items. 
Unfortunately,  there  were  too  few  items  containing  any  true  "emergent"  properties  to  do  meaningful  statistical 
tests.  Thus,  it  was  necessary  to  develop  new  materials  to  examine  the  Springer  and  Murphy  claims. 

Experiment  3  involved  a  set  of  44  items  which  were  obtained  by  asking  subjects  to  provide  properties  for  72 
items  which  we  judged  to  contain  true  emergent  properties.  The  44  items  chosen  for  the  experiment  were 
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done  so  on  the  basis  of  neither  the  adjective  nor  the  noun  having  any  listing  of  the  "emergent"  property  by  40 
subjects  in  this  pre-test.  The  chosen  44  items  were  tested  with  the  relatedness-ratings  procedure  (as  we  did 
with  the  Springer  and  Murphy  items)  to  make  certain  that  the  emergent  properties  are  truly  NOT  part  of  the 
adjective  or  noun  by  itself.  These  items  were  then  presented  under  a  new  experimental  design,  -  one 
involving  the  auditory  presentation  of  these  adjective-noun  combinations  embedded  in  sentences. .  The 
motivation  for  this  change  in  method  is  two-fold.  First,  and  most  important,  there  is  a  large  array  of  subtle 
evidence  suggesting  that  the  processing  of  words  "in  language"  (i.e.  in  ongoing  language  processing)  is 
considerably  different  than  that  found  in  isolated  presentation  of  words  or  word  pairs  (or  triplets,  etc.).  Thus, 
considering  that  much  of  conceptual  combination  occurs  (in  real-life)  in  actual  conversation  or  reading,  we 
decided  to  examine  the  temporal  course  of  component  processes  of  conceptual  combination  in  a  sentence- 
comprehension  fiamework  as  well  as  in  the  word-pair  visual  framework  (as  discussed  above).  The  second 
motivation  for  this  move  was  to  allow  the  use  of  cross-modal  lexical  priming.  This  technique,  which  allows 
presentation  of  probes  (and  the  study  of  priming  at  any  time  during  hearing  of  the  words  in  a  sentence,  allows 
for  temporal  precision  in  the  testing  of  activation  of  adjective  and  noun  meanings,  as  well  as  emergent 
property  meanings.  (This  is  so  in  that ,  with  auditory  presentation,  one  can  know  precisely  when  the  relevant 
information  has  been  heard  and  processed.  In  visual  presentation  involving  more  than  one  word,  it  is  difiBcult 
to  tell  precisely  what  point  the  listener  has  reached.  There  were  3  different  temporal  points  (during 
processing)  at  which  the  probe  related  to  the  noun  alone  or  the  emergent  property  (or  controls  for  these  items) 
were  examined:  200  msecs  before  the  adjective  in  the  adjective-noun  pair  was  heard  in  the  sentence  (test  pt. 

1),  immediately  at  the  onset  of  the  adjective(test  pt  2),  and  immediately  after  the  end  of  the  noun  in  the 
sentence(test  pt  3). 

The  results  of  this  set  of  studies  is  as  follows:  At  all  test  points,  priming  was  found  for  probes  related  to  the 
noun  AND  to  the  emergent  property  of  the  adjective-noun  pair.  This  suggests  that  the  earliest  probe  position 
was  still  not  early  enough  to  not  be  effected  by  hearing  the  adjective-noun  pair.  This  is  problematic  in  that 
the  first  test  point  was  intended  as  a  'baseline'  position  in  which  one  could  see  no  effects  of  either  emergent  or 
noun  properties.  It  compels  us  to  run  yet  another  set  of  experiments  with  new  materials  attempting  to  obtain 
a  'O'  baseline  effect.  (Exp.  4)  However,  the  results  do  tell  us  that  at  any  point  that  we  get  activation  of  the 
emergent  property  interpretation,  we  also  get  activation  of  the  NOUN  property.  Thus,  at  the  least.  Springer 
and  Murphy  must  be  wrong  about  the  Emergent  property  supplanting  the  noun  properties. 

We  anticipate  that  Experiment  4  -  replicating  3,  but  with  earlier  initial  probe  and  new  materials  will  be 
completed  by  March  31,  1995  and  a  paper  with  Swinney  and  Smith  as  co-authors,  as  well  as  a  graduate 
Student,  Maura  Pilotti,  on  this  work  will  be  submitted  by  March  31,  1995. 

Relevant  Publications  from  this  work  (see  attached  list  at  end  of  this  document):  (12),  (14) 


2.  Reasoning  and  Categorization 

A  second  line  of  research  which  we  have  undertaken  concerns  the  idea  that  there  are  two  kinds  of 
categorization,  corresponding  to  whether  categorization  is  based  on  similarity  or  reasoning.  The  principle 
behind  this  work  is  that  the  basis  for  when  similarity  or  reasoning  are  employed  in  categorization  has  to  do,  at 
least  partially,  with  the  amount  of  time  that  has  transpired  during  processing.  Our  empirical  work  here  is 
based  primarily  on  a  prior  study  by  Rips  (1989)  .  On  each  trial  of  Rips'  experiment,  subjects  were  presented 
with  a  description  of  an  object  that  mentioned  a  single  value  on  a  single  dimension  (e.g.,  an  object's  diameter), 
and  were  required  to  decide  which  of  two  categories  the  object  belonged  to  (where  the  value  given  was  in  the 
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middle  of  the  subject's  estimated  value  of  that  dimension  for  each  of  the  two  concepts;  these  values  were 
collected  from  each  subject  on  each  trial  before  the  "mean"  value  of  the  dimension  was  provided  to  them  for 
the  categorization).  For  example.  In  Rips  experiment,  each  subject  was  asked  to  provide  the  average  size 
(diameter)  of  a  quarter  and  of  a  pizza.  The,  subjects  were  asked  to  categorize  an  item  as  either  a  PIZZA  or  a 
QUARTER  when  that  item  was  "an  object  3  inches  in  diameter"  (where  3  inches  was  the  mean  of  the 
subject's  estimate  of  diameter  for  a  quarter  and  a  pizza)  In  this  study,  subjects  judged  the  item  more  likely  to 
be  a  pizza  than  a  quarter,  even  though  it  had  previously  been  demonstrated  that  the  object  was  considered 
more  similar  to  a  quarter  than  a  pizza.  In  cases  like  this,  it  appeared  that  categorization  is  not  based  on 
similarity  and  instead  presumably  reflects  a  reasoning  process  (where  the  reasoning  is  based  on  the  feet  that 
the  size  of  a  quarter  is  constrained). 

In  our  studies,  (carried  out  in  conjunction  with  Dr.  Steve  Sloman,  a  post  doctoral  student  at  Michigan)  we 
have  tried  to  determine  what  factors  lead  to  reasoning-based  categorization  versus  similarity-based 
categorization.  One  factor  we  have  explored  is  the  scarcity  of  the  information  given  about  fee  object  to  be 
categorized.  In  Rips'  experiment,  this  information  was  very  sparse.  In  our  3  studies  feus  fer,  we  have  varied 
fee  sparsity  of  fee  information  provided  to  fee  subject  and  fee  manner  of  presentation  of  that  information. 

The  first  experiment  involved  presenting  fee  Rips  information  ( fee  Sparse  condition)  and  a  condition  in 
which  subjects  were  given  extra  information  (  fee  Rich  condition).  For  example,  fee  sparse  conditions  for 
fee  Quarter-  Pizza  example  would  involve  telling  fee  subject  feat  fee  object  was  "3  inches  in  diameter".  The 
rich  condition  would  involve  telling  fee  subject  that  fee  object  was  "  3  inches  in  diameter  and  a  shiny  silver 
color".  Thus,  in  fee  rich  condition,  one  piece  of  "typical"  information  was  added.  The  results  indicate  that 
when  fee  object  description  is  relatively  rich  subjects  make  their  categorizations  on  fee  basis  of  similarity 
(i.e.-  similarity  to  typical  information).  However,  when  fee  information  is  Sparse,  fee  Rips  effect  is 
replicated,  in  feat  categorization  is  based  on  reasoning.  This  suggested  to  us  feat  reasoning-based 
categorization  may  be  what  people  do  when  fee  information  is  impoverished. 

The  second  set  of  experiment  in  this  area  involved  obtaining  fee  protocol  information  (judgments  as  to  size, 
etc.  of  each  object  in  fee  experiment)  at  fee  beginning  of  fee  experiment  for  all  item,  rather  than  just  before 
each  trial.  In  these  cases,  Ss'  categorization  was  based  largely  on  similarity  (typicality)  in  both  fee  sparse 
and  rich  conditions.  Relatedly,  there  was  a  hint  of  a  speed-up  in  response  time  under  these  conditions.  Thus, 
it  may  be  feat  subjects  forget  their  own  estimates  over  time  and  fee  basis  for  categorization  reverts  from 
reasoning  to  similarity.  Overall,  it  appears  that  rapid  categorization,  and  fee  more  general  cases  of 
categorization  appear  to  be  based  on  similarity.  It  appears  that,  in  order  to  obtain  theory-based  (reasoning- 
based)  categorization,  conditions  have  to  be  such  feat  fee  subject  is  aware  that  he/she  may  have  to  defend 
his/her  decision  (as  might  occur  when  protocols  and  judgments  occur  on  fee  same  trial,  wife  sparse 
information  available). 

Research  in  this  area  is  proceeding  wife  work  on  speeded  processing  and  delayed  processing  to  determine 
more  precisely  when  reasoning  is  and  can  be  drawn  into  fee  categorization  process. 

Relevant  Publications  from  this  work  (see  attached  list  at  end  of  this  document):  (1),  (3) 


3.  Temporal  decomposition  and  modularity  during  discourse  processing 

One  important  aspect  of  fee  current  grant  was  fee  investigation  of  whether  there  are  isolatable,  independent 
stages  of  reasoning  feat  are  driven  purely  by  fee  initial  stages  of  perceptual  (form)  input  and  not  by  "top- 
down"  (world  knowledge)  information.  A  major  motivation  for  this  work  has  been  fee  general  assumption  of 
most  research  in  fee  field  of  reasoning  feat  "reasoning"  has  access  to  "general  (world)  knowledge",  and,  feus 
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that  it  is  not  comprised  of  modular  subprocesses.  This  general  assumption  was,  at  one  time,  also  held  for 
work  in  natural  language  processing.  However,  careful,  on-line  (real-time)  study  of  natural  language 
processing  has  demonstrated  that,  in  certain  stages,  language  processing  appears  be  highly  modular. 
Examination  of  the  current  literature  on  plausible  reasoning  suggested  that  the  general  assumption  of  non¬ 
modularity  for  reasoning  was  likely  a  mistaken  one,  but  that  the  only  way  to  discover  the  nature  of  such 
processing  was  by  the  application  of  "real-time"  experimental  techniques  —  techniques  that  reflect  moment- 
by-moment  processes  that  occur  during  such  reasoning,  i.e.,  in  "real-time"—  to  conditions  of  reasoning. 

Given  that  the  only  current  support  for  modularity  of  processing,  as  demonstrated  through  temporal 
decomposition  techniques,  lies  in  various  areas  of  language  processing,  it  was  felt  to  be  important  that  some 
examination  on  this  grant  be  made  of  recent  claims  that  purport  to  dispute  the  findings  of  modularity  in 
language  processing;  if  there  is  no  such  modularity  in  language  processing,  that  lessens  considerably  one 
premise  of  this  grant  -  namely,  that  such  modularity  will  also  be  found  in  plausible  reasoning. 

Thus,  our  third  line  of  research  examined  carefully  the  role  of  discourse  information  in  "predicting"  the 
grammatical  role  of  potential  referential  antecedents.  This  work  (carried  out  in  conjunction  with  Dr.'s  Jerry 
Fodor  and  Merrill  Garrett)  examined  a  claim  by  Dr.  William  Marslen-Wilson  and  Dr.  Lorraine  Tyler(1982) 
of  a  case  demonstrating  an  apparent  interactive  (anti-modular)  effect  in  discourse  processing.  Their  work 
provides  what  is  perhaps  the  most  striking  current  support  for  the  interactionist  view  of  parsing. 

Subjects  in  their  experiment  heard  discourses  followed  by  related  sentence  fragments.  For  example,  a  typical 
stimulus  might  be: 

"As  Philip  was  walking  back  from  the  shop,  he  saw  an  old  woman  trip  and fall  flat  on 

her  face  in  the  street.  She  seemed  unable  to  get  up  again.  Running  towards..." 

Immediately  at  the  end  of  the  sentence  fragment,  a  visual  target  for  a  naming  task  was  displayed;  one  subject 
group  received  the  target  liim',  and  the  comparison  group  received  the  target  "her'.  The  targets  were  always 
anaphoric  pronouns. 

The  question  of  interest  involved  the  interpretation  of  the  gerundive  expression  'running'.  Notice,  in  the  first 
place,  that  this  is  understood  as  having  an  implicit  subject.  It  is  reasonable  to  suppose  that  supplying  this 
subject  is  part  of  the  hearer's  task  in  understanding  the  sentence.  Second,  notice  that  so  far  as  the  syntactical 
structure  of  the  discourse  is  concerned,  the  implicit  subject  could  be  either  Philip  or  the  old  woman.  What 
tells  the  hearer  who  it  was  that  did  the  running  is  the  interaction  of  semantic  information  in  the  discourse 
context  with  his  real-world  knowledge.  That  is,  given  the  discourse  information  that  the  old  woman  fell 
down,  and  the  real-world  mformation  that  old  women  who  have  frllen  down  are  unlikely  to  be  up  and  running 
in  the  next  sentence,  the  listener  can  infer  that  it  is  "Philip,"  rather  than  "the  old  woman"  that  is  the  implicit 
subject  of  "running".  The  experimental  question  is  whether  the  listener  assigns  subjects  to  gerunds  by  making 
such  extralinguistic  inferences  on  line  (immediately).  Evidence  that  the  listener  does  so  would  tell  strongly  in 
favor  of  the  claim  that  syntactic  and  semantic  information  interact  (are  not  modular)  in  parsing. 

Suppose,  consonant  with  the  interactive  account,  that  by  the  time  the  subject  reaches  the  end  of  the  sentence 
fragment  (hence  at  some  time  prior  to  the  presentation  of  the  naming  target)  he  has  made  the  context-based 
inference  that  'Philip'  is  the  subject  of  'nmning'.  Now  consider  the  two  experimental  conditions.  If  the  target 
is  "her,'  the  gender  marking  of  the  pronoun  requires  that  its  antecedent  in  the  discourse  must  be  'the  old 
woman'.  This  assignment  is  compatible  with  the  contextual  bias  for  taking  'Philip'  to  be  the  subject  of 
'running,'  and  the  performance  of  the  naming  task  can  proceed  smoothly.  If,  however,  the  target  is  Turn',  then 
there  is  a  conflict  with  the  contextual  bias.  For  one  thing,  if  liim'  is  assigned  as  the  object  of  'nmning 
towards'  in  a  sentence  where  'Philip'  has  already  been  assigned  as  its  subject,  then  the  speaker  is  represented 
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as  saying  that  Philip  is  running  towards  Philip,  which  seems  hardly  plausible.  Moreover,  this  analysis  would 
make  the  sentence  ungrammatical  since  if 'Philip'  is  both  the  subject  and  the  object  of  running  towards,'  the 
target  pronoun  ought  to  be  reflexive. 

In  short,  the  naming  response  to  Tiim'  as  target  should  be  inhibited  if  the  discourse  context  has  been  used  to 
infer  the  subject  of  'running  towards'  as  the  interactionist  account  of  parsing  requires.  If,  on  the  other  hand, 
no  such  contextually  based  inference  has  been  made  by  the  time  the  target  is  presented,  then  there  is  no 
reason  why  reaction  times  for  the  Turn'  targets  should  differ  from  those  for  the  'her'  targets.  In  short,  the 
modular  parser  predicts  no  difference  between  the  targets;  the  interactionist  parser  predicts  that  the  response 
times  for  liim'  will  be  longer  than  those  for  'her'.  In  Marslen-Wilson  Tyler's  experiment,  the  observed 
reaction  times  favor  the  interactionist  prediction. 

We  tested  the  predictions  of  the  interactive  account  of  gerundive  phrase  parsing  by  using  a  cross-modal 
priming  (CMP)  task  with  reaction  times  for  naming  responses  as  the  dependent  measure.  (Variants  of  this 
technique  have  been  applied  in  several  studies  of  sentence  processing  (e.g.,  Swinney,  Onifer,  Prather  and 
Hirshkowitz,  1979),  lexical  ambiguity  (e.g.,  Tanenhaus,  Leiman  and  Seidenberg,  1979;  Swiimey,  1979  )  and, 
more  recently,  of  pronoun  and  empty  category  interpretation  (see,  e.g.,  Nicol  and  Swinney,  1990  for  a 
review)).  The  task  is  similar  to  the  one  used  by  Marslen-Wilson  and  Tyler  in  that  the  sentence  stimuli  are 
auditory  and  the  naming  targets  are  visual.  But  the  experimental  techniques  differ  markedly  in  that  the  CMP 
task  does  not  require  the  subject  to  integrate  the  visual  probe  into  the  structure  of  the  stimulus  sentence,  nor 
does  it  require  the  subject  to  respond  to  sentence  fragments. 

In  our  variant  of  the  CMP  methodology,  subjects  listen  to  tape  recorded  test  sentences  while  watching  a  CRT 
display;  at  various  points  during  the  auditory  presentation  of  the  sentence,  naming  targets  appear  on  the  CRT 
screen.  Reaction  times  for  naming  targets  that  had  previously  occurred  in  the  sentence  (i.e.  in  the  auditory 
chamiel)  are  compared  with  reaction  times  for  otherwise  similar  control  targets  that  had  not.  The  application 
of  the  method  to  the  present  materials  relies  on  the  following  assumption:  when  an  anaphoric  element  is 
assigned  a  discourse  antecedent,  semantic  (and  other)  information  about  the  antecedent  becomes  active  at,  or 
very  shortly  after,  the  occurrence  of  the  anaphoric  element.  In  the  present  case,  it  is  assumed  that  this 
reactivated  information  is  then  available  to  mediate  repetition  priming.  There  exists  extensive  evidence  in 
support  of  this  assumption  (e.g.,  Bever  and  McElree  ,1988;  Nicol  and  Swinney,  1989;  Gamsey,  Tanenhaus. 
and  Chapman,  1989;  Fodor,  1989;  Tanenhaus,  Boland,  Gamsey,  and  Carlson,  1989) .  Thus,  for  example, 
naming  of  the  visual  target  'Philip'  should  be  primed  when  it  occurs  near  'he'  (e.g.,  at  the  point  marked  by  "^') 
in  a  discourse  such  as: 

"As  Philip  was  walking  back  from  the  shop  he  saw  an  old  lady  trip  and  fall  flat  on  her  face  in 

the  street.  She  seemed  imable  to  get  up  again  .  He  *  ran  rapidly  toward  her  and  carefully 

helped  her  to  her  feet." 

Notice  that  the  prediction  that  there  will  be  priming  for  'Philip'  at  the  *  position  in  this  discourse  is  compatible 
with  assuming  that  the  process  of  binding  the  anaphoric  pronoun  does  not  access  semantic  information  in  the 
discourse.  This  is  because.  Since  'Philip'  is  the  only  discourse  NP  that  agrees  with  the  pronoun  in  gender,  the 
assignment  of 'Philip'  as  the  pronoun's  antecedent  can  be  syntactically  determined. 

The  question  of  primary  interest  is  whether  comparable  priming  would  be  found  at  or  near  the  word 
"Ruiming"  in  a  variant  of  this  discourse  where  the  sentence  containing  the  probed  position  starts  with  a 
gemndive;  that  is  a  sentence  that  lacks  an  overt,  gender  marked  subject  pronoun.  For  example: 

"  Running  *  rapidly  toward  her  and ... " 
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The  occurrence  of  priming  of 'Philip'  in  the  *  position  of  this  discourse  would  imply  that  semantic/pragmatic 
information  about  the  context  has  been  used  to  determine  the  syntactic  subject  of  the  gerund,  and  this  would 
support  an  interactive  account  of  the  original  Tyler  and  Marslen-Wilson  results.  Conversely,  the  failure  to 
find  early  priming  would  support  a  modular  picture  according  to  which  grammatical  information  (like  gender 
agreement),  but  not  semantic/pragmatic  information,  is  recruited  on-line  to  determine  syntactic  properties  of 
the  input. 

The  sentences  we  used  were  adapted  from  the  Marslen-Wilson  and  Tyler  experiment.  Changes  made  were  to 
insure  that  lexical  co-occurrence  restrictions  were  not  available  to  determine  the  antecedents  of  the  pronoun 
targets  (i.e.,  that  there  were  two  syntactically  permissible  antecedents  for  each  target)  and  also  that  the 
discourse  was  plausible  and  semantically  well  integrated.  There  were  30  basic  discourses  used. 

The  pattern  of  results  is  flatly  incompatible  with  the  interactive  analysis  advanced  by  Marslen-  Wilson  and 
Tyler  for  the  naming  times  for  pronoun  targets  presented  in  their  original  experiment.  The  Marslen-Wilson 
and  Tyler  analysis  requires  that  the  implicit  and  explicit  versions  should  show  similar  profiles  in  our 
experiment.  In  particular,  it  requires  evidence  that  the  contextually  mandated  subject  of  the  gerund  is 
facilitated  at  the  position  indicated  by  the  *. 

However,  no  indication  of  such  facilitation  is  observed.  Reaction  times  for  the  implicit  condition  are  the 
same  for  both  naming  targets  in  the  gerundive  versions.  There  is  thus  no  support  for  the  view  that  the 
consequences  of  a  semantic  analysis  of  the  discourse  are  accessible  to  the  processes  that  are  deployed  in  the 
parser's  initial  attempts  to  determine  the  values  of  the  implicit  arguments  of  verbs. 

The  results  just  discussed  make  it  seem  implausible  that  the  'missing'  subjects  of  gerunds  are  recovered  by  the 
on-line  exploitation  of  discourse  information,  in  the  manner  that  strong  interactionist  theory  suggests.  Rather, 
a  modular  view  of  processing  is  still  supported,  even  here. 

We  suggest  the  following  model  accounts  for  the  data  we  obtained  (and  that  of  Marslen-Wilson  and  Tyler): 
assignments  of  anaphoric  referents  to  zero  pronouns  are  triggered  by  surface  features  of  the  sentence  under 
analysis;  notably,  they  are  triggered  when  the  parser  encounters  an  overt  anaphoric  element-  So,  in  the  case 
of  a  stimulus  like  the  example  presented  above,  the  subject  of 'crawling'  is  left  unbound  till  the  pronoun  'her' 
is  encountered.  Upon  encountering  this  trigger,  all  NPs  in  the  discourse  are  considered  as  candidate  referents 
for  all  the  anaphoric  elements,  both  overt  and  covert.  The  assignment  chosen  is  constrained  by  lexically 
carried  information  (gender,  number,  context  restrictions,  etc.)  and  by  considerations  of  the  overall  coherence 
of  the  interpretation  of  the  discourse.  In  the  overt  pronoun  condition,  by  contrast,  this  process  is  initiated  as 
soon  as  the  hearer  encounters  the  subject  NP  'he',  so  information  associated  with  'fireman'  is  available  to 
facilitate  priming  at  probe  position  indicated  by  the  *. 

Beside  the  suggestion  that  contextually  based  binding  of  implicit  anaphors  is  delayed  until  triggers  are 
encountered  (rather  than  occurring  on  line),  the  aspect  of  this  account  that  is  of  primary  relevance  to  the 
modularity  issues  is  the  suggestion  that  triggers  automatically  activate  aU  the  (grammatically  relevant) 
possible  referents  in  a  discourse.  This  implies  that  the  role  of  semantic/pragmatic  information  is  restricted  to 
post-activation  filtering  of  the  candidate  assignments,  a  view  that  would  comport  with  the  general  principle 
proposed  above,  that  the  characteristic  role  of  extragrammatical  information  in  parsing  is  to  reject  analyses 
that  are  grammatically  licit  but  implausible. 

Relevant  Publications  from  this  work  (see  list,  and  end  of  this  report):  (2),  (6),  (9) 
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4.  Examinations  of  reasoning  and  cognitive  processing  in  neurologically-involved  populations. 

The  fourth  aspect  of  this  grant  examined  cognitive  and  language  processing,  examining  the  role  of  modularity 
and  initial  automatic  stages  of  processing,  as  revealed  in  brain  damaged  populations.  Cognitive  deficits 
caused  by  focal  brain  damage  ( as  seen  in  the  aphasias)  are  hypothesized  to  fractionate  along  functional  lines 
of  a  'natural'  cognition.  Hence,  we  undertook  to  examine  whether  cognitive  processes  which  have 
demonstrated  'modularity'  in  early  stages  of  processing  loose  that  modularity  under  brain  damage.  Or, 
conversely,  whether  early-processing  modularity,  in  language  and  in  plausible  reasoning,  is  a  fundamental 
part  of  the  cognitive  architecture  of  the  cognitive  system,  and  hence,  immune  to  such  disruption. 

Experiment  1  involved  establishing  an  automatic/  modular  processing  effect  in  normal  language  processors. 
This  was  established  for  a  condition  of  structural  gap-filling,  involving  establishing  the  link  between  a 
'moved'  constituent  (the  noun  phrase  in  an  object  and  subject  relative  clause  and  in  a  passive  construction 
(see  publications:  (4),  (6),  (1 1).  The  data,  in  short,  demonstrate  an  AUTOMATIC,  MODULAR  (Non- 
contextually  penetrated)  effect  of  IMMEDIATE  reactivation  of  the  'moved'  constituent  in  the  CANONICAL 
deep-structure  position  when  it  is  reached  by  the  listener.  For  example,  in  the  sentence: 

The  policeman  saw  the  boy  who  the  crowd  at  the  party  accessed _ of  the  crime. 

In  this,  the ' _ '  indicates  the  deep-structure,  canonical  position  of  the  moved  NP  (THE  BOY).  In  all 

studies,  regardless  of  context,  it  was  demonstrated  that  as  soon  as  the  ' _ '  position  was  reached  by  the 

listener  he/she  reactivated  the  antecedent  "THE  BOY"  at  this  point.  This  was  established  through  the  use  of 
the  cross-modal  lexical  priming  technique  (see  above  for  description). 

Publications  (5),  (7),  (8)  and  (10)  demonstrate,  in  sum,  that  this  EARLY,  AUTOMATIC  aspect  of  language 
processing  (which  provides  a  necessary  front-end  for  plausible  reasoning,  in  that  the  sentence  must  first  be 
understood  to  develop  plausible  reasoning  situations  from  it)  remains  automatic  and  MODULAR  even  in  the 
fece  of  brain  damage  (Broca's  aphasia,  Wernicke's  aphasia)  and  aging.  This  work  has  led  to  arguments  that 
1)  Modularity  in  early  processing  stages  is  universal  and  ubiquitous  and  2)  that  this  is  an  architectural 
(functional)  property  of  early  perceptual  (language,  cognitive)  processing. 

Publications  from  work  in  this  section  (see  below):  (4),  (5),  (6)  (7),  (8),  (10),  (11),  (13) 
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Publications  resulting  from  work  on  AFOSR-91-0225  from  March  15, 1991-March  15, 1994 

1.  Smith  E.E.  and  Sloman,  S.  Similarity  versus  Rule-Based  Categorization  (in  press)  Memory  and  Cognition. 

2.  Smith  E.  E.  and  Swinney,  D.A.  The  Role  of  Schemas  in  Reading  Text:  A  real-time  examination  (1992) 

Discourse  Processes.  15.  303-316. 

3.  Biolsi,  K.  and  Smith  E.E.  The  automaticity  of  Similarity-Based  Reasoning,  (in  press)  In  Pritchard,  P., 

Brown,  D.,  and  Weinstein  C.  (Eds)  Perspectives  on  Cognition  and  Motivation.  Essays  in  honor  of 
Wilbert  J.McKeachie.  Hillsdale,  N.J. 

4.  Osterhout,  L.  and  Swinney  D.  On  the  temporal  course  of  gap-filling  during  comprehension  of  Verbal 

Passives  (1993)  Journal  of  Psvcholinguistic  Research.  22,  2,  273-286. 

5.  Zurif,  E.  Swinney,  D.  Prather,  P.  Solomon,  J.  and  Bushell,  C.  An  on-line  analysis  of  Syntactic 

Processing  in  Broca's  and  Wernicke's  aphasia  (1993)  Brain  and  Language.  45,  448-464. . 

6.  Osterhout,  L.,  Holcomb,  P.  and  Swinney,  D.  Brain  Potentials  elicited  by  garden-path  sentences: 

evidence  of  the  application  of  verb  information  during  parsing.  Journal  of  Experimental 
Psychology:  Learning.  Memory,  and  Cognition  vol  20  no  4  pp  786-806  1994 

7.  Zurif,  E.  and  Swinney,  D.  The  Neuropsychology  of  Language  (in  press)  In:  Gemsbacher,  M.A.(Ed.) 

Handbook  of  Psycholinguistics.  Academic  Press,  N.Y.  1993 

8.  Zurif,  E.  and  Swinney,  D.  Modularity  need  not  imply  locality:  damaged  modules  can  have  non-local 

effects,  (in  press)  Behavioral  and  Brain  Sciences. 

9.  Fodor,  J.A.,  Garrett,  M.  and  Swinney,  D.A.  (under  review)  A  modular  effect  in  parsing.  The  Journal  of 

Language  and  Cognitive  Processes.  This  paper  has  also  been  presented  at  the  Conference  on 
Sentence  Processing.  New  York,  1992. 

10.  Swinney,  D.  Zurif,  E.  Prather,  P.  Love,  T.  Neurological  Distribution  of  Processing  Operations 

underlying  Language  Comprehension  (under  review)  Journal  of  Cognitive  Neuroscience 

11.  Zurif,  E.  Swinney,  D.  Prather,  P.  Wingfield,  A.  and  Brownell,  H.(in  press)  An  on-line  analysis  of 

syntactic  processing  in  the  elderly.  Journal  of  Psvcholinguistic  Research  1995 

12.  Gray,  K.C.  and  Sate  (in  press)  The  Role  of  Instance  Retrieval  and  Understanding  Complex 

Concepts.  Memory  and  Cognition 

13.  Swiiuiey,  D.  and  Zurif,  E.  The  Neurological  Organization  of  Lexical  and  Structural 

Operations  in  Sentence  Comprehension:  Findings  and  Methodological  Considerations, 
p.  234  Linguistics  and  Cognitive  Neuroscience  Hillert,  D.  Ed  Westdeutscher  Verlag 
1994 

14.  Nicol,  J.  Fodor,  J.D.  and  Swinney,  D.  Using  Cross-Modal  Lexical  Decision  Tasks  to  Investigate 
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